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Watermark embedding and detection. 



FELT OF THE INVENTION 

The invention relates to a method and arrangement far watermarking an 
information signal, for example, an audio or video signal. The invention also relates to a 
method and arrangement for detecting a watermark in such an information Signal. 

5 

BACKGROUND OF THE INVENTION 

A known method of watermarking a video signal is disclosed in International 
Patent Application WO-A-99/45705. In this method, a watermark pattern is added to the video 
signal. A watermark detector correlates the same pattern with the suspect signal. If the 

10 correlaion exceeds a given threshold, the pattern is said to be present The presence or 

absence of the pattern represents a single bit of information. The embedded watermark may 
also caxy a multi-bit payload. In the system disclosed in WO-A-99/45705, the payload is 
represented by a combination of one or more basic patterns and spatially shifted versions 
thereof. The payload is encoded into the respective shift vectors. The watermark detector 

IS correlates each of the basic patterns with the suspect signal, and determines the spatial 

positions of the basic patterns with respect to each other. The detector further checks whether 
said positions constitute a valid payload. 



the watsrmark detector to have locally stored versions of said patterns. In view hereof, it is 
20 desired that the watermarking system employs only a few different patterns. The patterns 
being used arc kept secret to die outside world. However, even without knowledge of the 
patterns-, a hacker can compromise the system if he has the relevant embeddsr at his disposal. 
He ma) feed an arbitrary input signal to said embedder and subtract the signal from its 
watermarked version. Hie difference signal thus obtained resembles the watermark of any 
25 other watermarked signal, depending on the perception model used in the watermark 

embedcer at hand. If the difference signal is combined with (e.g. added to or subtracted from) 
a watermarked signal, the embedded watermark will substantially be cancelled or at least no 
longer represent a valid payload. In either case, the embedded watermark has been made 
ineffective. 
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OBJECT AND SUMMARY OF THE INVENTION 

It is an object of the invention to provide a more secure method and 
arrangement for embedding and detecting a watermark in an information signal, even if a 
5 hacker has a watermark embedder at his disposal. 

To this end. the method in accordance with the invention comprises the steps 
of: analyzing a given property of the information signal and determining an actual value of 
said property; associating different watermarks with distinct values of said property; and 
embediiing the watermark associated with said actual value. The corresponding watermark 
10 detection method comprises the steps of: analyzing a given property of the information signal 
and determining an actual value of said property; associating different watermarks with 
disunci values of said property; and detecting the watermark associated with said actual value. 

With the invention is achieved that the embedded watermark pattern changes 
from ti lie to time, as a function of the information signal content Feeding an arbitrary signal 
IS to an emb edder so as to produce a signal that resembles the watermark, as described above, 
does not work anymore because the arbitrary signal has different properties. A significant 
advantage of the invention is that the number of different watermark patterns that the detector 
must store can be held much lower. Said number is a result of balancing detector complexity 
versus security. 

20 There are numerous examples of properties of the information signal that can be 

used for selecting the watermark pattern to be embedded. The only requirement to be fulfilled 
is its robustness or invariance with respect to the embedded watermark. Advantageous 
examples of properties are distinct distributions of luminance values of a video signal, or 
distinct shapes of the frequency spectrum of an audio signal. 

25 Further aspects of the invention will be apparent from and elucidated with 

reference to the embodiments described hereinafter. The examples relate to watermark 
embedding and detection of video signals, but it will be appreciated that the invention equally 
applies to audio signals or any other type of multimedia signals. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows schematically a diagram of a watermark embedder in accordance 
with ttit invention. 

Fig. 2 shows schematically a diagram of a watermark detector in accordance 
with this invention. 
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3 22.11.1999 
Fig. 3 shows an arrangement to illustrate the operation of the watermark 
embed der and detector. 

Figs. 4 and 5 show further embodiments of the watermark embedder in 
accordance with the invention, 
5 Fig. 6 shows a further embodiment of the watermark detector in accordance 

with tfce invention. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 shows schematically a diagram of an embodiment of a watermark 

10 embedder 1 in accordance with the invention. It will here be assumed that the embedded 

watermark represents a 1-bit payload. For example, the absence of a watermark indicates that 
the vidso signal may freely be copied, whereas the presence of a predetermined watermark 
denotes that making a copy of the signal is prohibited 

The embedder receives an input video signal I in the form of a sequence of 

IS images, and comprises an adder 11 which adds a watermark pattern Wi to each image. The 
embedder further comprises an image analyzer 12, a selector 13 and a read only memory 14 in 
which <i plurality of different watermark patterns Wi„Wn are stared. The analyzer 12 receives 
the vidso signal and analyzes a given property P of the video signal as Amotion of the time. 
The actual value of property P found by analyzer 12 is applied to the selector 13. In response 

20 (hereto, the selector selects one of the stared watermark patterns Wi..Wn to the adder 11 for 
embedding. 

The analyzer 12 may take numerous forms. A few examples will be given to 
provide* sufficient teaching to enable a skilled person to design appropriate alternative 
embodiments. The property being analyzed may be the distribution of luminance values across 

25 the image (spatial distribution) or across a sequence of images (temporal distribution). In a 
first ex:unple, the analyzer divides each image in sub-images, and determines which of said 
sub-im;tge8 has the highest average luminance. The relevant sub-image number is the actual 
value of property P. In a second example, the analyzer assigns a "0" to each sub-image having 
a low a/erage luminance and a "1" to each sub-image having a high average luminance. Each 

30 video image is now characterized by an n-bit code, where n is the number of sub-images. The 
relevant n-bit code is the actual value of property P. Tbe property being analyzed may also be 
local image activity. Such an analysis can easily be carried out in the frequency domain. 

Fig. 2 shows schematically a diagram of a preferred embodiment of a 
watermark detector 2 in accordance with the invention. The detector receives a suspect video 
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signal J and comprises an image analyzer 22, a selector 23 and a read only memory 24 that axe 
identical to the corresponding counterparts of embedder 1. Accordingly, the analyzer 22 
analyze the same property P of the video signal, and the selector 23 selects the same 
watermark pattern W from the stored patterns Wi..Wn, as the embedder. 



correlation between each image of the suspect video signal and the applied watermark pattern 
Wi- If Ihe correlation exceeds a predetermined threshold, the selected watermark pattern Wj is 
said to be present (D=l), otherwise it is said to be absent (D=0), 

The correlation circuit 21 is preferably of a type which performs the correlation 

10 for all possible spatial positions of the applied watermark with respect to the image. Such a 
correlation circuit is disclosed in WO-A-99/45705, It generates a correlation pattern which 
exhibits a peak for each of the spatial positions of the watermark. In WO-A-99/45705 is 
described that multiple peak positions may represent a payload However, as mentioned above, 
the payload in this example is a 1-bit copy control signal. The detection circuit 2 will consider 

IS the presence of 2 or more peaks as an invalid payload (D=0). 

It is assumed that the watermark patterns Wi..Wn are secret and can neither be 
retrieved by interrogating the embedder or detector circuits. As will now be explained with 
reference to Fig. 3, the invention prevents a hacker from compromising the system when he 
happens to have an embedder at his disposal. In Fig. 3, a potential hacker receives a video 

20 signal V being watermarked by an embedder la. The signal V may be a recorded signal in 
which case the actual embedding has taken place a long time ago. The embedder la is of a 
type as described above with reference to Fig. 1. 

The hacker has a same embedder lb at his disposal. An arbitrary video signal X 
is applied to said embedder lb so as to locally generate a watermarked video signal X'. An 

25 adder 2> subtracts the artutrary signal X from its watermarked version X 1 . The difference signal 
(which strongly resembles the embedded watermark pattern) is then combined with (added to 
or subtracted from) the watermarked signal V by a further adder 4. The thus processed suspect 
signal V" is applied to a watermark detector 2 as described above with reference to Kg. 2. 

Without the provisions of the invention, both embedders la and lb embed the 

30 same watermark in the respective input signals. This results either in cancellation of the 

watenr ark in the suspect signal V" or in an invalid payload due to multiple occurrences of the 
watenrark pattern W at different positions* In both cases, the detector generates an output 
signal 1?=0 and the hacking attack is successful. 



5 



The detector further comprises a correlation circuit 21 which calculates the 




13:43 



VAN-+31 40 2743469 



NAAR-EPA/EPO/OEB R1JSWIJK PAG'S 010 



23 NOV '99 13:48 PHILIP^IP NL 040 2743489 ^ . P. 11 

5 22.11.1999 
With the provisions of the invention, the watermark Wi (i=l ..N) in signal V 
will generally differ from the watermark Wj (j=l~N) in signal X\ because the contents of the 
original video signals V and X are different The property analysis algorithm of detector 2 
respomis to the contents of signal V" which is substantially equal to the contents of V. 
5 Consequently, the watermark pattern being checked by detector 2 is the watermark pattern Wi 
which lias been embedded by rnihnririftr la. The detector ignores the additional presence of a 
different pattern Wj, and the hacking attack thus fails. 

A possible work-around is feeding to embedded lb the watermarked signal V 
instead of an arbitrary signal X, so as to force embedder lb to select the same watermark Wi as 
10 embedder la. To avoid this, the embedders la and lb are preferably of a type that refrains 
from embedding a watermark in an already watermarked signal. Fig. 4 shows a schematic 
diagram of such an embedder. It comprises the same adder 11, image analyzer 12, selector 13 
and ROM 14 as the embedder which is shown in Fig, 1. It further comprises the correlation 
circuit :il of the detector which is shown in Fig. 2. The correlation circuit 21 detects whether 
IS the input signal I already includes the watermark pattern W £ to be embedded. If that is the case 
(D=l), a switch IS is controlled to prevent the watermark pattern Wi from being embedded 
multiple times. 

Fig. S shows a schematic diagram of a watermark embedder for embedding 
multi-bit payload in the video signal. The embedder comprises the same adder 11, image 

20 analyzer 12, selector 13 and ROM 14 as described before with reference to Fig. L The ROM 
14 now stores a plurality of sees of watermark patterns. The embedder further includes an 
encodir g circuit 16 which receives a selected set i of basic watermark patterns W u » W^, . 
and encodes a multi-bit payload d into the relative positions of said patterns. The basic 
patterns have a relatively small size (e.g. 128x128 pixels). Hie watermark pattern generated by 

25 encodex 16 is subsequently tiled over the image by a tiling circuit 17. The ROM 14 stores 

different sets of basic patterns for different values of signal property P. The actual set of basic 
patterns being applied to encoder 16 is controlled by the actual value of property P and 
changes as a function of time. 

Fig. 6 shows the corresponding watermark detector. The detector comprises a 

30 folding circuit 25 for folding and storing image segments of 128x128 pixels in a buffer prior 
to correlation. The detector further comprises the same correlation circuit 21, image analyzer 
22, selector 23 and read only memory 24 as described before with reference to Fig* 2. The 
ROM 2*1 stores different sets of basic patterns for different values of signal property P. The 
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actual net of basic patterns being applied to the correlation circuit 21 is controlled by the actual 
value cf property P. 

It should be noted the invention is not restricted to the watermarking systems 
described in the embodiments. For example, a watermarking system is known that uses n 
5 different watermark patterns, each pattern corresponding to one bit of an n-Wt payload. In 
accordance with this invention, the embedder and detector of such a system include different 
sets of n patterns. A particular set is then selected in response to the actual value of a signal 
property. 

In summary! a method and arrangement for embedding and detecting a 
10 watermark in an information signal is disclosed. The embedded watermark (W£ is selected 
(13) from a plurality of watermarks (Wl.Wn) in dependence upon a property P of the signal. 
An exaaiple of such a property is the distribution of luminance values of the current video 
image as calculated by an analysis circuit (12). The corresponding watermark detector 
performs the same operation: the watermark being looked for depends on the same signal 
15 property. With the invention is achieved that the embedded watennark changes from time to 
time as a function of the information signal content, so that it can not easily be hacked 
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CLAIMS: 



1 # A method of embedding a watermark in an information signal, comprising the 

steps cf: 

- azutlyzing a given property of the information signal and determining an actual value of 
said property; 

S - associating different watermarks with distinct values of said property; and 

- sel acting the watermark associated with said actual value for embedding in the information 
Signal. 

2. A method as claimed in claim 1, in which the information signal is a sequence 
10 of vidfo images, said analyzing step comprising analyzing a spatial or temporal distribution of 

luminance values, each distinct distribution of luminance values constituting a value of said 
properi y of the information signal. 

3. A method as in claim 1, in which the information signal is a sequence 
IS of audio signal segments, said analyzing step comprising analyzing a shape of the frequency 

spectrum of said audio segments, each distinct shape of the frequency spectrum constituting a 
value cf said property of the information signal. 

4. A method as claimed in claim 1, in which the embedded watermark is a 

20 compilation of two or more basic watermark patterns constituting a set of basic watermark 
pattonui being selected from different sets in dependence upon the actual value of the property 
of the information signal. 

5. A method of detecting a watermark in an information signal, comprising the 
25 steps of; 

- ana .yzing a given property of the information signal and determining an actual value of 
saic. property; 

- associating different watermarks with distinct values of said property; and 

- selecting and detecting the watermark associated with said actual value. 
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6. A method as claimed in claim 5, in which the information signal is a sequence 
of video images, said analyzing step comprising analyzing a spatial or temporal distribution of 
luminance values, each distinct distribution of luminance values constituting a value of said 

5 proper :y of the information signal. 

7. A method as claimed in claim 5, in which the information signal is a sequence 
of aud o signal segments, (he method comprising the steps of calculating the frequency 
spectrum for each segment, each distinct shape of said frequency spectrum constituting a value 

10 of said property of the information signal. 

8. A method as claimed in claim 5, in which the embedded watermark is a 
combiaation of two or more basic watermark patterns constituting a set of basic watermark 
patterns being selected from different sets in dependence upon the actual value of the property 

IS of the information signal. 

9. A watermark embedder for embedding a watermark in an information signal, 
compiising: 

- means (12) for analyzing a given property (P) of the information signal and determining an 
20 ac :ual value of said property, 

- nutans (14) for associating different watermarks with distinct values of said property; and 

- nutans (13) for selecting the watermark associated with said actual value for embedding 
(1 1) in the information signal. 

25 10. A watermark detector for detecting a watermark in an information signal, 

compiising; 

- msans (22) for analyzing a given property of the information signal and determining an 
actual value of said property; 

- msans (24) for associating different watermarks with distinct values of said property; and 
30 - msans for selecting (23) and detecting (21) the watermark associated with said actual 

vslue. 

11- A watermark embedder as claimed in claim 9, further including a watermark 

detect or as claimed In claim 10, and comprising means (15) for refraining from embedding the 
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selected watermark in response to detection in the information signal of said selected 
watermark by said detector. 
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ABSTllACT; 



A method and arrangement for embedding and detecting a watermark in an 
information signal is disclosed. The embedded watermark (WO is selected (13) from a 
plurality of watermarks (Wi,.W N ) in dependence upon a property P of the signal. An example 
of audi a property is the distribution of luminance values of the current video image as 
5 calculated by an analysis circuit (12). The corresponding watermark detector performs the 
same operation: the watermark being looked for depends on the same signal property. With the 
invention is achieved that the embedded watermark changes from time to time as a function of 
the information signal content, so that it can not easily be hacked. 

10 Fig. 1 



13:43 



VAN-+31 40 2743468 



NAAR-EPA/EPO/OEB RIJSWIJK PAG'S 016 



^^SSUMSil "SB 13:50 PHILIPS-CIP NL «KA<m 



1 r?. 




FIG.1 




FIG. 2 



1-III-PHN17772 



|gflFl|§^g^|l^|j998 13:43 VAN-431 40 27434B9 



NAAR-EPA/EPO/OEB RIJSWIJK PAG'S 017 



23 NOV 'TO 13:50 



PHILIPS CIP NL 040 2743489 





FIG. 4 



iW^SS^^B" 13:43 



VAN-+31 40 2743489 



2-III-PHN17772 

NAAR-EPA/EPO/OEB RIJSWIJK PAG'S 018 




•14 



w 1(1 w 1>2 w v w 2t2 w N|1 W N|2 

FIG. 5 



25 

4- 



21 



C 

7" 



-22 



D 



9 •* 



-23 



—24 



w 1,2 «W ^2,2 W Ni1 W Ni2 

FIG. 6 



3-III-PHN17772 



13:43 



VAH-+3I 40 2743489 



NAAR-EPA/EPO/OEB RIJSWIJK PAG'S 019 



